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(54) INFORMATION PROCESSOR/PROCESSING METHOD AND STORAGE MEDIUM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an information 
processor where specified information such as 
electronic watermark information is buried into encoded 
or quantized data by installing a burying means burying 
specified information into data outputted from a 
decoding means and an encoding means quantizing and 
encoding again data outputted from the burying means. 
SOLUTION: Compressed image data which is read from 
a memory 105 and is entropy-encoded is decoded by an 
entropy decoder 106 corresponding to an entropy 
encoder 104 used at the time of compression and is 
inputted to an electronic watermark burying unit 107. 
One DOT coefficient is selected from one block and a 
burying bit showing electronic watermark information is 
buried into the selected DOT coefficient. The burying of 
electronic watermark completes by quantizing the DOT 
coefficient into which the burying bit is buried. The size 
of a quantizing step at that time corresponds to the 
intensity of burying. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] An information processor characterized by having a decode means which once 
decodes data quantized and encoded and carries out reverse quantization, an embedded means 
which embeds specific information to data outputted from said decode means, and a coding 
means to quantize again data outputted from said embedded means, and to encode. 
[Claim 2] An information processor characterized by having a decode means to once decode 
encoded data, an embedded means which embeds specific information to data at data outputted 
from said decode means, and a coding means to encode again data outputted from said 
embedded means. 

[Claim 3] An information processor characterized by having a decode means which decodes data 
quantized and encoded and carries out reverse quantization, and an extract means to extract 
specific information embedded to data outputted from said decode means. 

[Claim 4] An information processor characterized by having a decode means to decode encoded 
data, and an extract means to extract specific information embedded to data outputted from said 
decode means. 

[Claim 5] An information processor indicated by any of claim 1 to claim 4 characterized by said 
specific information being digital-watermarking information they are. 

[Claim 6] Data inputted into said decode means is the information processor indicated by any of 
claim 1 to claim 5 characterized by being the image data to which a discrete cosine transform or 
wavelet transform was given they are. 

[Claim 7] Said decode means is the information processor indicated by any of claim 1 to claim 6 
characterized by choosing whether data inputted is decoded for every predetermined unit they 
are. 

[Claim 8] It is the information processor which has a generation means to generate image data, a 
compression means to perform data compression processing to generated image data, and an 
embedded means that embeds specific information at image data by which the data compression 
was carried out, and is characterized by the ability of said compression means and said 
embedded means to be performed independently. 

[Claim 9] An information processor indicated by claim 8 characterized by said specific 
information being digital-watermarking information. 

[Claim 10] Actuation of said embedded means is the information processor indicated by claim 8 
or claim 9 characterized by being carried out when data is outputted from said image processing 
system, or when said generation means is not operating. 

[Claim 1 1] An information processing method characterized by quantizing again data with which 
data quantized and encoded was once decoded, reverse quantization was carried out, specific 
information was embedded to data by which decode and reverse quantization were carried out, 
and said specific information was embedded, and encoding. 

[Claim 12] An information processing method characterized by encoding again data with which 
encoded data was once decoded, specific information was embedded to decoded data, and said 
specific information was embedded. 

[Claim 13] An information processing method characterized by extracting specific information 
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which decoded data quantized and encoded, carried out reverse quantization, and was embedded 
to data by which reverse quantization was carried out. 

[Claim 14] An information processing method characterized by extracting specific information 
which decoded encoded data and was embedded to decoded data. 
[Claim 15] An information processing method indicated by any of claim 11 to claim 14 
characterized by said specific information being digital-watermarking information they are. 
[Claim 16] It is the information processing method characterized by it being the image- 
processing method which generates image data, performs data compression processing to 
generated image data, and embeds specific information at image data by which the data 
compression was carried out, and said compression step and said embedded step being 
performed independently. 

[Claim 17] An information processing method indicated by claim 16 characterized by said 
specific information being digital-watermarking information. 

[Claim 18] It is the storage characterized by to have the code of the step which quantizes again 
the data with which it is the storage with which the program code of the information processing 
which embeds specific information to data was recorded, and the code of the step which said 
program code once decodes the data which was quantized at least and encoded, and carries out 
reverse quantization, the code of the step which embeds specific information to the data by 
which decode and reverse quantization were carried out, and said specific information were 
embedded, and encodes. 

[Claim 19] It is the storage characterized by to have a code of a step which is the storage with 
which a program code of information processing which embeds specific information to data was 
recorded, and encodes again a code of a step to which said program code once decodes data 
encoded at least, a code of a step which embeds specific information to decoded data, and data 
with which said specific information was embedded. 

[Claim 20] It is the storage characterized by to have the code of a step which is the storage 
with which a program code of information processing which extracts specific information 
embedded to data was recorded, and extracts a code of a step which said program code 
decodes data which was quantized at least and encoded, and carries out reverse quantization, 
and specific information embedded to data by which reverse quantization was carried out. 
[Claim 21] It is the storage characterized by having a code of a step from which it is the storage 
with which a program code of information processing which extracts specific information 
embedded to data was recorded, and said program code extracts a code of a step to which data 
with which it encoded at least is decoded, and specific information that it was embedded to data 
with which it decoded. 

[Claim 22] It is the storage characterized by it being the storage with which a program code of 
an image processing which generates image data, performs data compression processing to 
generated image data, and embeds specific information at image data by which the data 
compression was carried out was recorded, and a code of said compression step and a code of 
said embedded step being performed independently. 

[Claim 23] A storage indicated by any of claim 18 to claim 22 characterized by said specific 
information being digital-watermarking information they are. 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to a storage at the 
information processor which embeds information [ **** ] like digital-watermarking information to 
the data which was related with the storage, for example, was encoded or quantized by an 
information processor and its method, and the list and its method, and a list. 
[0002] 

[Description of the Prior Art] A computer in recent years and network development are 
remarkable, and various information, such as an alphabetic character, an image, and voice, and 
the so-called multimedia information are computers, and they are treated through the network. 
An image and audio data are that an image and audio data carry out coding compression since 
the amount of data is comparatively large, and processing which makes the amount of data small 
is performed. If image data is compressed, more image information can be transmitted to a high 
speed through a network. Although the common-name JPEG method which compresses the 
multiple-value static image in ITU-T recommendation T.81 as image compression technology has 
spread, aiming at compression of high performance, standardization of JPEG2000 is considered 
further. 

[0003] Although the coding method with which JPEG uses a discrete cosine transform (DCT) is 
a base, JPEG2000 has the leading method which uses discrete wavelet transform. Generally, the 
coding equipment of JPEG and JPEG2000 consists of frequency converters 701, quantizers 702, 
the entropy encoders 703, etc. which perform a discrete cosine transform and discrete wavelet 
transform, as shown in drawing 1 A. On the other hand, the expanding equipment of JPEG and 
JPEG2000 consists of an entropy decoder 704, a reverse quantizer 705, a reverse frequency 
converter 706, etc., as shown in drawing 1 B. 

[0004] By the way, since the image used in a computer or a network and voice are digitized data, 
it is in the environment which can reproduce those data easily, and the quality of data does not 
deteriorate by the duplicate, either. For this reason, in order to protect the copyright of these 
multimedia information, processing which embeds copyright information as digital watermarking to 
an image or audio data is performed. It is possible by extracting digital watermarking from 
multimedia data to acquire copyright information and to prevent an unjust duplicate. 
[0005] As a method of embedding digital watermarking, it is the NTT method "the digital- 
watermarking method in the frequency domain for the protection of copyrights of a digital 
image" (Nakamura, a brook, Takashima, SCIS'97-26A, January, 1997) using a discrete cosine 
transform, for example, The National Defense Academy method "the watermark signing method 
to the image by PN sequence" (Onishi, **, Matsui, SCIS'97-26B, January, 1997) using discrete 
Fourier transform, Mitsubishi using discrete wavelet transform, the Kyushu University method 
"experimental consideration about the safety and reliability of the digital-watermarking 
technology using wavelet transform" (Ishizuka, Sakai, Sakurai, SCIS97-26D, January, 1997), etc. 
are held. 

[0006] Generally, these digital-watermarking embedding equipments consist of a frequency 
converter 801 which performs a discrete cosine transform and discrete wavelet transform, a 
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digital-watermarking embedding machine 802 quantized according to the information which 
embeds the frequency component, and a reverse frequency converter 803, as shown in drawing 
2 A. On the other hand, a digital-watermarking extractor consists of a frequency converter 804 
and a digital-watermarking extractor 805 which extracts the information embedded from the 
quantized frequency component, as shown in drawing 2 B. 
[0007] 

[Problem(s) to be Solved by the Invention] When performing digital-watermarking embedding 
processing and compression processing to image data, it is easy to compress the image data 
where digital watermarking was embedded. However, it is difficult to embed digital watermarking 
to the compressed data. Since the data by which compression processing was carried out is 
code data by which entropy code modulation was carried out, it is difficult data to embed digital 
watermarking directly at it. 

[0008] Once elongating with the image inverter 907 from the entropy decoder 905 and returning 
the image data x compressed with the entropy encoder 904 from the image transformation 
machine 902 to image data as shown in drawing 3 in order to embed digital watermarking to the 
compressed data, digital watermarking will be embedded with the image inverter 910 from the 
image transformation machine 908, and the output will be further repressed with the entropy 
encoder 913 from the image transformation machine 911. 

[0009] On the other hand, since the output of digital-watermarking embedding processing is the 
image data itself, it can be inputted into compression processing as it is. 

[0010] However, much the applications and the equipments using coding of JPEG etc., such as 
equipments, such as a digital camera and color facsimile, a still picture transmission system, and 
a still picture processing system, are put in practical use. In these applications or equipment, 
using hardware, such as ASIC, it encodes first, namely, an input image is used as compressed 
data in many cases. Therefore, in these applications or equipment, the increase of cost great for 
embedding digital watermarking before compression coding will be caused. 
[0011] Moreover, also in JPEG2000 under current examination, since the unification with 
compression coding and digital watermarking is not fully considered, a possibility that the 
problem that it is difficult like the case of JPEG to embed digital watermarking will arise is high. 
[0012] This invention aims at offering the information processor which it is and embeds specific 
information like digital-watermarking information to the data encoded or quantized and its 
method for solving an above-mentioned problem. 
[0013] 

[Means for Solving the Problem] This invention is equipped with the following configurations as a 
way stage which attains the aforementioned purpose. 

[0014] An information processor concerning this invention is characterized by to have a decode 
means which once decodes data quantized and encoded and carries out reverse quantization, an 
embedded means which embeds specific information to data outputted from said decode means, 
and a coding means quantize again data outputted from said embedded means, and encode. 
[0015] Moreover, it is characterized by having a decode means to once decode encoded data, an 
embedded means which embeds specific information to data at data outputted from said decode 
means, and a coding means to encode again data outputted from said embedded means. 
[0016] Moreover, it is characterized by having a decode means which decodes data quantized 
and encoded and carries out reverse quantization, and an extract means to extract specific 
information embedded to data outputted from said decode means. 

[0017] Moreover, it is characterized by having a decode means to decode encoded data, and an 
extract means to extract specific information embedded to data outputted from said decode 
means. 

[0018] An information processing method concerning this invention is characterized by 
quantizing again data with which data quantized and encoded was once decoded, reverse 
quantization was carried out, specific information was embedded to data by which decode and 
reverse quantization were carried out, and said specific information was embedded, and 
encoding. 

[001 9] Moreover, it is characterized by encoding again data with which encoded data was once 
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decoded, specific information was embedded to decoded data, and said specific information was 
embedded. 

[0020] Moreover, it is characterized by extracting specific information which decoded data 
quantized and encoded, carried out reverse quantization, and was embedded to data by which 
reverse quantization was carried out. 

[0021] Moreover, it is characterized by extracting specific information which decoded encoded 

data and was embedded to decoded data. 

[0022] 

[Embodiment of the Invention] Hereafter, the image processing system which is an information 
processor of 1 operation gestalt concerning this invention is explained to details with reference 
to a drawing. In addition, this invention relates to the information processor which performs 
protection of copyright, alteration prevention of an image, various information records, etc., and 
its method by performing compression processing and embedding processing of digital 
watermarking to digital image data. 
[0023] 

[The 1st operation gestalt] Drawing 4 is the block diagram showing the outline configuration of 
the image processing system of the 1st operation gestalt. First, the flow of processing is 
explained briefly. 

[0024] In drawing 4, the image data x inputted is multiple-value image data which has the 
predetermined number of bits per pixel. Predetermined transform processing is performed to the 
multiple-value image data inputted with the discrete cosine transform vessel 102, and it is 
decomposed into a predetermined frequency component. The pixel of input image data is 
decomposed into the block which does not lap mutually, and a discrete cosine transform is 
performed in the block unit. A discrete cosine transform can be performed using a degree type. 
Xi (u, v) — = — two — /— N-C — (— u — ) — C — (— v — ) — sigmausigma — vxi (m, n) - 
cos — [— l(2m+1) — u — pi — } — /(2Ns) — ] - cos — [— {(2n+1) — v — pi — } — /(2Ns) — J 

It is C (p) at the time of (1), however p = 0. Time [ of = 1/root2p !=0 ] c (p) = 1 [0025] 

Since the image data of a natural image includes many signals of a low-frequency component, it 
can bias a signal toward a low frequency field by giving a discrete cosine transform. The 
transform coefficient (it is called a "DCT coefficient" below) outputted from the discrete cosine 
transform machine 102 is inputted into a quantizer 103. 

[0026] As mentioned above, since the image data of a natural image includes many signals of a 
low-frequency component, if many bits are assigned by the low-frequency component of image 
data and few bits are assigned by the high frequency component, it can compress image data 
efficiently by quantization. 

[0027] The quantized image data is inputted into the entropy encoder 104 which performs 
Huffman coding etc., and a symbolic language with a long symbolic language short to the high 
information on appearance probability is assigned to the low information on appearance 
probability, consequently average symbolic-language length is shortened. The compression image 
data by which entropy code modulation was carried out is inputted into the memory 105, such as 
magnetic storage. 

[0028] Below, the processing which embeds digital watermarking at the compression image data 
memorized by memory 105 is explained. 

[0029] The compression image data by which reading appearance was carried out from memory 

105 and by which entropy code modulation was carried out is decoded with the entropy decoder 

106 corresponding to the entropy encoder 104 used at the time of compression, and quantization 
data is obtained. Reverse quantization is carried out with the reverse quantizer 109 
corresponding to the quantizer 103 used at the time of compression, and this quantization data 

is returned to a DCT coefficient. And digital watermarking is embedded for a DCT coefficient 
with the digital-watermarking embedding vessel 107. That is, the digital-watermarking embedding 
machine 107 outputs the DCT coefficient where digital watermarking was embedded by operating 
a DCT coefficient. 

[0030] Compression processing of the DCT coefficient where digital watermarking was embedded 
is again carried out with a quantizer 110 and the entropy encoder 108, and the output of the 
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entropy encoder 108 is again memorized by memory 105. 

[0031] The following methods are held to the embedding method of digital watermarking using a 
discrete cosine transform. 

[0032] An input image is divided into a 8x8-pixel square block, and the DCT coefficient obtained 
by the discrete cosine transform is inputted into the digital-watermarking embedding machine 
107. And one DCT coefficient is chosen from one blocks, and the bit (it is called an "embedded 
bit" below) showing digital-watermarking information is embedded for the selected DCT 
coefficient. In addition, the frequency component which embeds an embedded bit is chosen from 
the component of the comparison-low frequency except a dc component at random. 
[0033] And the embedding of digital watermarking is completed by quantizing the DCT coefficient 
where the embedded bit was embedded. The magnitude of a quantization step at this time is 
equivalent to embedded reinforcement. 

[0034] The example which embeds the bit (it is called an "embedding bit" below) '0' for 
embedding digital watermarking or T is shown below. First, the value q which quantized s_ {u_0 
v_0} by the formula (2) is acquired. 

q = «s_ {u_0 v_0}/h » h — For the value h of a DCT coefficient, s_ {u_0 v_0} is [ embedding on- 
the-strength < <x» ] (2), however the maximum integer which does not exceed x. [0035] And c 
nearest to s_ {u_0 v_0} is made into the DCT coefficient after digital-watermarking embedding 
among c obtained from a formula (3) or a formula (4). 

At the time of an embedded bit '0' c = q+ht+q/4 — At the time of (3) embedded bit T c = 
q+ht+3q/4 — (4), however t are the natural number. [0036] In the above-mentioned example of 
digital-watermarking embedding, the initial value set to the random number generator which 
generates the random digits for specifying an embedding component, and the value of a 
quantization step become a key. 

[0037] Although the equipment with which from compression processing of image data to 
embedding processing of digital watermarking was unified was explained above, the processing 
from the discrete cosine transform machine 102 to memory 105 is usually unified as picture 
compression equipment 101 in many cases. Therefore, when embedding digital watermarking at 
the compression image data memorized by memory 105, processing by the entropy encoder 110 
is only added from the entropy decoder 106 shown in drawing 4, embedding processing of digital 
watermarking is realized, and it is efficient. 

[0038] Moreover, when performing compression processing of image data, and embedding 
processing of digital watermarking to continuation, compression image data can also be inputted 
into the direct entropy decoder 106, without inputting into memory 105. Moreover, it is also 
****** to consider the output of the entropy encoder 108 as the output of an image processing 
system 101, without inputting into memory 105. 

[0039] Moreover, since embedding processing of digital watermarking can be performed 
independently of compression processing of image data when using memory 105, in case 
compression image data is outputted from an image processing system, embedding processing of 
digital watermarking is performed, or a usage, such as carrying out, when compression processing 
of image data is not performed (i.e., when image data x is not inputted), can be considered. 
[0040] Furthermore, what is necessary is just to control memory 105 so that compression image 
data is not outputted to the entropy decoder 106 from memory 105 when you do not need the 
embedding of digital watermarking. 
[0041] 

[The 2nd operation gestalt] Hereafter, the image processing system of the 2nd operation gestalt 
concerning this invention is explained. In addition, in this operation gestalt, about the same 
configuration as the 1st operation gestalt and abbreviation, the same sign is attached and the 
detailed explanation is omitted. 

[0042] Technique to embed digital watermarking explained in the 1 st operation gestalt quantizes 
DCT coefficient s_ {u_0 v_0} with Parameter h in < <sju_0v_0} » of a formula (2). Since this 
quantization differs from the quantization in data compression processing, it needs to return 
compression image data to a DCT coefficient in the 1st operation gestalt using the entropy 
decoder 106 and the reverse quantizer 109. 
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[0043] Here, the quantization used for embedding processing of digital watermarking is the same 
as the quantization used by data compression processing, or when it is processing in 
consideration of the quantization used by data compression processing, digital watermarking can 
be embedded to quantization data, without needing the reverse quantizer 109. 
[0044] Drawing 5 is the block diagram showing the example of a configuration of the image 
processing system which does not need the reverse quantizer 109. 

[0045] For example, if the parameter h in a formula (2) is made the same as the value of the 
quantization step used by the data compression, since the quantization data by which entropy 
decode was carried out is equivalent to < <s_ {u_0 v_0]/h », it is clear that its q of a formula (2) 
can be calculated using it and digital watermarking can be embedded. 

[0046] The case where the quantization used for data compression processing and embedding 
processing of digital watermarking was the same above was explained. When the quantization 
used for embedding processing of digital watermarking is, on the other hand, taking into 
consideration the quantization used for compression processing (i.e., when the value of two 
quantization steps has a certain relation), the quantization data by which entropy decode was 
carried out can be changed into complement child-ized data at embedding processing of digital 
watermarking. Therefore, also when the quantization used for embedding processing of digital 
watermarking is taking into consideration the quantization used for compression processing, as 
shown in drawing 2, it is clear that digital watermarking can be embedded without the reverse 
quantizer 109 at compression image data. 
[0047] 

[The 3rd operation gestalt] Hereafter, the image processing system of the 3rd operation gestalt 
concerning this invention is explained. In addition, in this operation gestalt, about the same 
configuration as the 1 st operation gestalt and abbreviation, the same sign is attached and the 
detailed explanation is omitted. 

[0048] In an above-mentioned operation gestalt, although the embedding of digital watermarking 
using a discrete cosine transform was explained, this invention can embed digital watermarking 
using various image transformation other than a discrete cosine transform. For example, although 
discrete wavelet transform is leading as image transformation, since overall 
compression/expanding procedure is due to be performed with the configuration shown in 
drawing 1 A and 1B, this invention is effective in JPEG2000, also to JPEG2000. Although the 
various conversion which includes discrete Fourier transform and predicting coding further is 
mentioned as other image transformation, when the data compression of those translation data 
is carried out by quantization and entropy code modulation, embedding processing of digital 
watermarking by this invention is effective. 

[0049] Moreover, when using the same image transformation by not only the example of 
embedding of digital watermarking shown in the 1st and 2nd operation gestalt but the data 
compression, and the embedding of digital watermarking, technique to embed versatility can use 
with the digital-watermarking embedding vessel 1 07. 

[0050] Moreover, although the 1st and 2nd operation gestalt explained the object which embeds 
digital watermarking as image data, this invention can be applied, not only image data but when 
performing various data compressions to the sound data containing voice etc. and embedding 
digital watermarking to it. 

[0051] Moreover, as shown in drawing 6 A and drawing 6 B, the embedding block of digital 
watermarking shown in the 1st and 2nd operation gestalt can be made to be able to become 
independent, and can also be used as equipment. 

[0052] As shown in drawing 7, a switch 1 1 1 can be formed in front of a quantizer 103, and the 
DCT coefficient inputted into a quantizer 103 can also be chosen from which output of the 
image transformation machine 102 or the digital-watermarking embedding machine 107. If it does 
in this way, in the 1st and 2nd operation gestalt, it is possible to share the entropy encoder 104 
and a quantizer 103 between compression processing of image data and embedding processing of 
digital watermarking, and still more efficient equipment can be realized. 

[0053] Moreover, it sets to an image processing system equipped with a picture compression 
block and an image expanding block. By leading the output of the reverse quantizer 109 for 
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image expanding to the digital-watermarking embedding machine 107, and forming a switch 1 1 1 in 
front of a quantizer 103 further, as shown in drawing 8 It is possible to share the entropy 
encoder 104 and not only the quantizer 103 but the entropy decoder 106 and the reverse 
quantizer 109 for expanding processing between embedding processing of digital watermarking, 
and still more efficient equipment can be realized. In addition, the image inverter 112 performs 
processing of the image transformation machine 102 and reverse. 
[0054] 

[The 4th operation gestalt] Hereafter, the image processing system of the 4th operation gestalt 
concerning this invention is explained. In addition, in this operation gestalt, about the same 
configuration as each above-mentioned operation gestalt and abbreviation, the same sign is 
attached and the detailed explanation is omitted. 

[0055] Drawing 9 and drawing 10 are the block diagrams showing the example of a configuration 
of the equipment which extracts digital watermarking from the compressed data with which 
digital watermarking was embedded, and the example of a configuration corresponding to the 
embedding equipment of digital watermarking which shows drawing 9 to drawing 6 A, and drawing 
10 are examples of a configuration which do not need the reverse quantizer corresponding to the 
embedding equipment of digital watermarking shown in drawing 6 B. 
[0056] The data inputted into the equipment shown in drawing 9 and drawing 10 is the 
compressed data with which digital watermarking was embedded. The compressed data inputted 
is changed into quantization data by the entropy decoder 501 corresponding to the entropy 
encoder 108 used for the embedding of digital watermarking. With the configuration shown in 
drawing 9, after the obtained quantization data is changed into the coefficient for which it 
depends on the image transformation methods, such as a DCT coefficient, with the reverse 
quantizer 502 corresponding to the quantizer 110 used for the embedding of digital watermarking, 
it is inputted into the digital-watermarking extractor 503. Quantization data is inputted into the 
digital-watermarking extractor 503 with the configuration shown in drawing 10. 
[0057] The digital-watermarking extractor 503 extracts the digital-watermarking information 
embedded by the extract processing corresponding to the embedding of digital watermarking. 
Extract processing of this digital watermarking should just be the technique corresponding to 
embedding processing of digital watermarking using the discrete cosine transform explained with 
the 1st and 2nd operation gestalt, and embedding processing of digital watermarking using the 
various image transformation explained with the 3rd operation gestalt. 

[0058] The image processing system of each operation gestalt mentioned above is applicable to 
a picture input device like a digital camera. In that case, though picture compression processing 
in these picture input devices is hardware-ized, if digital-watermarking embedding processing is 
realized by supplying a program to CPU, digital-watermarking embedding processing can be 
realized easily, without adding new hardware. Furthermore, since a real-time operation is not 
necessarily required of digital-watermarking embedding processing unlike data compression 
processing, when transmitting data to a personal computer etc. from picture input devices, such 
as a digital camera, or while the picture input device is not performing the image input, it can 
perform embedding processing of digital watermarking. Then, even when the throughput of CPU 
carried in the picture input device is small, it is possible to perform embedding of digital 
watermarking for a short time. 

[0059] Moreover, the image processing system of each operation gestalt mentioned above 
applicable also to an image I/O device like color facsimile equipment is clear. In that case, when 
digital watermarking embedded by the picture input device includes the digital-watermarking 
extract function shown in the 4th operation gestalt in an image output unit, the embedded 
digital-watermarking information is extracted. Under the present circumstances, when the 
regulation information over an image output is shown by the embedded digital-watermarking 
information, it is also possible to control an image output unit according to that regulation 
information. 

[0060] Moreover, each operation gestalt applicable to many systems, such as a still picture 
transmission system, a still picture processing system, etc. with compression applications, such 
as JPEG, mentioned above is clear. 
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[0061] As explained above, according to each operation gestalt mentioned above, by adding the 
easy processing means for the image processing system which has a picture compression 
function, digital-watermarking information can be embedded to the compressed data, and digital- 
watermarking information can be extracted. 
[0062] 

[Other operation gestalten] In addition, even if it applies this invention to the system which 
consists of two or more devices (for example, a host computer, an interface device, a reader, a 
printer, etc.), it may be applied to the equipments (for example, a copying machine, facsimile 
apparatus, etc.) which consist of one device. 

[0063] Moreover, it cannot be overemphasized by the purpose of this invention supplying the 
storage which recorded the program code of the software which realizes the function of the 
operation gestalt mentioned above to a system or equipment, and carrying out read-out 
activation of the program code with which the computer (or CPU and MPU) of the system or 
equipment was stored in the storage that it is attained. In this case, the function of the 
operation gestalt which the program code itself read from the storage mentioned above will be 
realized, and the storage which memorized that program code will constitute this invention. 
Moreover, it cannot be overemphasized that it is contained also when the function of the 
operation gestalt which performed a part or all of processing that OS (operating system) which is 
working on a computer is actual, based on directions of the program code, and the function of 
the operation gestalt mentioned above by performing the program code which the computer read 
is not only realized, but was mentioned above by the processing is realized. 
[0064] Furthermore, after the program code read from a storage is written in the memory with 
which the functional expansion unit connected to the functional expansion card inserted in the 
computer or a computer is equipped, it cannot be overemphasized that it is contained also when 
the function of the operation gestalt which performed a part or all of processing that CPU with 
which the functional expansion card and functional expansion unit are equipped based on 
directions of the program code is actual, and mentioned above by the processing is realized 
[0065] 

[Effect of the Invention] As explained above, according to this invention, the information 
processor which embeds specific information like digital-watermarking information to the data 
encoded or quantized, and its method can be offered. 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



TECHNICAL FIELD 

[The technical field to which invention belongs] This invention relates to a storage at the 
information processor which embeds information [ **** ] like digital-watermarking information to 
the data which was related with the storage, for example, was encoded or quantized by an 
information processor and its method, and the list and its method, and a list 
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PRIOR ART 



[Description of the Prior Art] A computer in recent years and network development are 
remarkable, and various information, such as an alphabetic character, an image, and voice, and 
the so-called multimedia information are computers, and they are treated through the network. 
An image and audio data are that an image and audio data carry out coding compression since 
the amount of data is comparatively large, and processing which makes the amount of data small 
is performed. If image data is compressed, more image information can be transmitted to a high 
speed through a network. Although the common-name JPEG method which compresses the 
multiple-value static image in ITU-T recommendation T.81 as image compression technology has 
spread, aiming at compression of high performance, standardization of JPEG2000 is considered 
further. 

[0003] Although the coding method with which JPEG uses a discrete cosine transform (DOT) is 
a base, JPEG2000 has the leading method which uses discrete wavelet transform. Generally, the 
coding equipment of JPEG and JPEG2000 consists of frequency converters 701, quantizers 702, 
the entropy encoders 703, etc. which perform a discrete cosine transform and discrete wavelet 
transform, as shown in drawing 1 A. On the other hand, the expanding equipment of JPEG and 
JPEG2000 consists of an entropy decoder 704, a reverse quantizer 705, a reverse frequency 
converter 706, etc., as shown in drawing 1 B. 

[0004] By the way, since the image used in a computer or a network and voice are digitized data, 
it is in the environment which can reproduce those data easily, and the quality of data does not 
deteriorate by the duplicate, either. For this reason, in order to protect the copyright of these 
multimedia information, processing which embeds copyright information as digital watermarking to 
an image or audio data is performed. It is possible by extracting digital watermarking from 
multimedia data to acquire copyright information and to prevent an unjust duplicate. 
[0005] As a method of embedding digital watermarking, it is the NTT method "the digital- 
watermarking method in the frequency domain for the protection of copyrights of a digital 
image" (Nakamura, a brook, Takashima, SCIS97-26A, January, 1997) using a discrete cosine 
transform, for example, The National Defense Academy method "the watermark signing method 
to the image by PN sequence" (Onishi, **, Matsui, SCIS'97-26B, January, 1997) using discrete 
Fourier transform, Mitsubishi using discrete wavelet transform, the Kyushu University method 
"experimental consideration about the safety and reliability of the digital-watermarking 
technology using wavelet transform" (Ishizuka, Sakai, Sakurai, SCIS'97-26D, January, 1997), etc. 
are held. 

[0006] Generally, these digital-watermarking embedding equipments consist of a frequency 
converter 801 which performs a discrete cosine transform and discrete wavelet transform, a 
digital-watermarking embedding machine 802 quantized according to the information which 
embeds the frequency component, and a reverse frequency converter 803, as shown in drawing 
2 A. On the other hand, a digital-watermarking extractor consists of a frequency converter 804 
and a digital-watermarking extractor 805 which extracts the information embedded from the 
quantized frequency component, as shown in drawing 2 B. 
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EFFECT OF THE INVENTION 



[Effect of the Invention] As explained above, according to this invention, the information 
processor which embeds specific information like digital-watermarking information to the data 
encoded or quantized, and its method can be offered. 
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TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] When performing digital-watermarking embedding 
processing and compression processing to image data, it is easy to compress the image data 
where digital watermarking was embedded. However, it is difficult to embed digital watermarking 
to the compressed data. Since the data by which compression processing was carried out is 
code data by which entropy code modulation was carried out, it is difficult data to embed digital 
watermarking directly at it. 

[0008] Once elongating with the image inverter 907 from the entropy decoder 905 and returning 
the image data x compressed with the entropy encoder 904 from the image transformation 
machine 902 to image data as shown in drawing 3 in order to embed digital watermarking to the 
compressed data, digital watermarking will be embedded with the image inverter 910 from the 
image transformation machine 908, and the output will be further repressed with the entropy 
encoder 913 from the image transformation machine 911. 

[0009] On the other hand, since the output of digital - watermarking embedding processing is the 
image data itself, it can be inputted into compression processing as it is. 

[0010] However, much the applications and the equipments using coding of JPEG etc., such as 
equipments, such as a digital camera and color facsimile, a still picture transmission system, and 
a still picture processing system, are put in practical use. In these applications or equipment, 
using hardware, such as ASIC, it encodes first, namely, an input image is used as compressed 
data in many cases. Therefore, in these applications or equipment, the increase of cost great for 
embedding digital watermarking before compression coding will be caused. 
[001 1] Moreover, also in JPEG2000 under current examination, since the unification with 
compression coding and digital watermarking is not fully considered, a possibility that the 
problem that it is difficult like the case of JPEG to embed digital watermarking will arise is high. 
[0012] This invention aims at offering the information processor which it is and embeds specific 
information like digital-watermarking information to the data encoded or quantized and its 
method for solving an above-mentioned problem. 
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MEANS 



[Means for Solving the Problem] This invention is equipped with the following configurations as a 
way stage which attains the aforementioned purpose. 

[0014] An information processor concerning this invention is characterized by to have a decode 
means which once decodes data quantized and encoded and carries out reverse quantization, an 
embedded means which embeds specific information to data outputted from said decode means, 
and a coding means quantize again data outputted from said embedded means, and encode. 
[0015] Moreover, it is characterized by having a decode means to once decode encoded data, an 
embedded means which embeds specific information to data at data outputted from said decode 
means, and a coding means to encode again data outputted from said embedded means. 
[0016] Moreover, it is characterized by having a decode means which decodes data quantized 
and encoded and carries out reverse quantization, and an extract means to extract specific 
information embedded to data outputted from said decode means. 

[0017] Moreover, it is characterized by having a decode means to decode encoded data, and an 
extract means to extract specific information embedded to data outputted from said decode 
means. 

[0018] An information processing method concerning this invention is characterized by 
quantizing again data with which data quantized and encoded was once decoded, reverse 
quantization was carried out, specific information was embedded to data by which decode and 
reverse quantization were carried out, and said specific information was embedded, and 
encoding. 

[0019] Moreover, it is characterized by encoding again data with which encoded data was once 
decoded, specific information was embedded to decoded data, and said specific information was 
embedded. 

[0020] Moreover, it is characterized by extracting specific information which decoded data 
quantized and encoded, carried out reverse quantization, and was embedded to data by which 
reverse quantization was carried out. 

[0021] Moreover, it is characterized by extracting specific information which decoded encoded 

data and was embedded to decoded data. 

[0022] 

[Embodiment of the Invention] Hereafter, the image processing system which is an information 
processor of 1 operation gestalt concerning this invention is explained to details with reference 
to a drawing. In addition, this invention relates to the information processor which performs 
protection of copyright, alteration prevention of an image, various information records, etc., and 
its method by performing compression processing and embedding processing of digital 
watermarking to digital image data. 
[0023] 

[The 1st operation gestalt] Drawing 4 is the block diagram showing the outline configuration of 
the image processing system of the 1st operation gestalt. First, the flow of processing is 
explained briefly. 

[0024] In drawing 4, the image data x inputted is multiple-value image data which has the 
predetermined number of bits per pixel. Predetermined transform processing is performed to the 
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multiple-value image data inputted with the discrete cosine transform vessel 102, and it is 
decomposed into a predetermined frequency component. The pixel of input image data is 
decomposed into the block which does not lap mutually, and a discrete cosine transform is 
performed in the block unit. A discrete cosine transform can be performed using a degree type. 
Xi (u, v) — = — two — /— N-C — (— u — ) — C — (— v — ) — sigmausigma — vxi (m, n) - 
cos — [— {(2m+1) — u — pi — } — /(2Ns) — ] - cos — [— {(2n+1) — v — pi — } — /(2Ns) — ] 

It is C (p) at the time of (1), however p = 0. Time [ of = 1/root2p !=0 ] c (p) = 1 [0025] 

Since the image data of a natural image includes many signals of a low-frequency component, it 
can bias a signal toward a low frequency field by giving a discrete cosine transform. The 
transform coefficient (it is called a "DCT coefficient" below) outputted from the discrete cosine 
transform machine 102 is inputted into a quantizer 103. 

[0026] As mentioned above, since the image data of a natural image includes many signals of a 
low-frequency component, if many bits are assigned by the low-frequency component of image 
data and few bits are assigned by the high frequency component, it can compress image data 
efficiently by quantization. 

[0027] The quantized image data is inputted into the entropy encoder 104 which performs 
Huffman coding etc., and a symbolic language with a long symbolic language short to the high 
information on appearance probability is assigned to the low information on appearance 
probability, consequently average symbolic-language length is shortened. The compression image 
data by which entropy code modulation was carried out is inputted into the memory 105, such as 
magnetic storage. 

[0028] Below, the processing which embeds digital watermarking at the compression image data 
memorized by memory 105 is explained. 

[0029] The compression image data by which reading appearance was carried out from memory 

105 and by which entropy code modulation was carried out is decoded with the entropy decoder 

106 corresponding to the entropy encoder 104 used at the time of compression, and quantization 
data is obtained. Reverse quantization is carried out with the reverse quantizer 109 
corresponding to the quantizer 103 used at the time of compression, and this quantization data 

is returned to a DCT coefficient. And digital watermarking is embedded for a DCT coefficient 
with the digital-watermarking embedding vessel 107. That is, the digital-watermarking embedding 
machine 107 outputs the DCT coefficient where digital watermarking was embedded by operating 
a DCT coefficient. 

[0030] Compression processing of the DCT coefficient where digital watermarking was embedded 
is again carried out with a quantizer 110 and the entropy encoder 108, and the output of the 
entropy encoder 108 is again memorized by memory 105. 

[0031] The following methods are held to the embedding method of digital watermarking using a 
discrete cosine transform. 

[0032] An input image is divided into a 8x8-pixel square block, and the DCT coefficient obtained 
by the discrete cosine transform is inputted into the digital-watermarking embedding machine 
107. And one DCT coefficient is chosen from one blocks, and the bit (it is called an "embedded 
bit" below) showing digital-watermarking information is embedded for the selected DCT 
coefficient. In addition, the frequency component which embeds an embedded bit is chosen from 
the component of the comparison-low frequency except a dc component at random. 
[0033] And the embedding of digital watermarking is completed by quantizing the DCT coefficient 
where the embedded bit was embedded. The magnitude of a quantization step at this time is 
equivalent to embedded reinforcement. 

[0034] The example which embeds the bit (it is called an "embedding bit" below) '0' for 
embedding digital watermarking or T is shown below. First, the value q which quantized s (uO 
v_0) by the formula (2) is acquired. 

q = «s_ {u_0 v_0}/h » h — For the value h of a DCT coefficient, s_ {u_0 v_0] is [ embedding on- 
the-strength < <x» ] (2), however the maximum integer which does not exceed x. [0035] And c 
nearest to s_ {u_0 v_0} is made into the DCT coefficient after digital-watermarking embedding 
among c obtained from a formula (3) or a formula (4). 

At the time of an embedded bit '0' c = q+ht+q/4 — At the time of (3) embedded bit T c = 
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q+ht+3q/4 — (4), however t are the natural number. [0036] In the above-mentioned example of 
digital-watermarking embedding, the initial value set to the random number generator which 
generates the random digits for specifying an embedding component, and the value of a 
quantization step become a key. 

[0037] Although the equipment with which from compression processing of image data to 
embedding processing of digital watermarking was unified was explained above, the processing 
from the discrete cosine transform machine 102 to memory 105 is usually unified as picture 
compression equipment 101 in many cases. Therefore, when embedding digital watermarking at 
the compression image data memorized by memory 105, processing by the entropy encoder 110 
is only added from the entropy decoder 106 shown in drawing 4, embedding processing of digital 
watermarking is realized, and it is efficient. 

[0038] Moreover, when performing compression processing of image data, and embedding 
processing of digital watermarking to continuation, compression image data can also be inputted 
into the direct entropy decoder 106, without inputting into memory 105. Moreover, it is also 
****** to consider the output of the entropy encoder 108 as the output of an image processing 
system 101, without inputting into memory 105. 

[0039] Moreover, since embedding processing of digital watermarking can be performed 
independently of compression processing of image data when using memory 105, in case 
compression image data is outputted from an image processing system, embedding processing of 
digital watermarking is performed, or a usage, such as carrying out, when compression processing 
of image data is not performed (i.e., when image data x is not inputted), can be considered. 
[0040] Furthermore, what is necessary is just to control memory 105 so that compression image 
data is not outputted to the entropy decoder 106 from memory 105 when you do not need the 
embedding of digital watermarking. 
[0041] 

[The 2nd operation gestalt] Hereafter, the image processing system of the 2nd operation gestalt 
concerning this invention is explained. In addition, in this operation gestalt, about the same 
configuration as the 1st operation gestalt and abbreviation, the same sign is attached and the 
detailed explanation is omitted. 

[0042] Technique to embed digital watermarking explained in the 1st operation gestalt quantizes 
DCT coefficient s_ {u_0 v_0} with Parameter h in < <s_{u_0v_0} » of a formula (2). Since this 
quantization differs from the quantization in data compression processing, it needs to return 
compression image data to a DCT coefficient in the 1st operation gestalt using the entropy 
decoder 106 and the reverse quantizer 109. 

[0043] Here, the quantization used for embedding processing of digital watermarking is the same 
as the quantization used by data compression processing, or when it is processing in 
consideration of the quantization used by data compression processing, digital watermarking can 
be embedded to quantization data, without needing the reverse quantizer 109. 
[0044] Drawing 5 is the block diagram showing the example of a configuration of the image 
processing system which does not need the reverse quantizer 109. 

[0045] For example, if the parameter h in a formula (2) is made the same as the value of the 
quantization step used by the data compression, since the quantization data by which entropy 
decode was carried out is equivalent to < <s_ {u_0 v_0}/h », it is clear that its q of a formula (2) 
can be calculated using it and digital watermarking can be embedded. 

[0046] The case where the quantization used for data compression processing and embedding 
processing of digital watermarking was the same above was explained. When the quantization 
used for embedding processing of digital watermarking is, on the other hand, taking into 
consideration the quantization used for compression processing (i.e., when the value of two 
quantization steps has a certain relation), the quantization data by which entropy decode was 
carried out can be changed into complement child-ized data at embedding processing of digital 
watermarking. Therefore, also when the quantization used for embedding processing of digital 
watermarking is taking into consideration the quantization used for compression processing, as 
shown in drawing 2 f it is clear that digital watermarking can be embedded without the reverse 
quantizer 109 at compression image data. 
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[0047] 

[The 3rd operation gestalt] Hereafter, the image processing system of the 3rd operation gestalt 
concerning this invention is explained. In addition, in this operation gestalt, about the same 
configuration as the 1st operation gestalt and abbreviation, the same sign is attached and the 
detailed explanation is omitted. 

[0048] In an above-mentioned operation gestalt, although the embedding of digital watermarking 
using a discrete cosine transform was explained, this invention can embed digital watermarking 
using various image transformation other than a discrete cosine transform. For example, although 
discrete wavelet transform is leading as image transformation, since overall 
compression/expanding procedure is due to be performed with the configuration shown in 
drawing 1 A and 1B, this invention is effective in JPEG2000, also to JPEG2000. Although the 
various conversion which includes discrete Fourier transform and predicting coding further is 
mentioned as other image transformation, when the data compression of those translation data 
is carried out by quantization and entropy code modulation, embedding processing of digital 
watermarking by this invention is effective. 

[0049] Moreover, when using the same image transformation by not only the example of 
embedding of digital watermarking shown in the 1 st and 2nd operation gestalt but the data 
compression, and the embedding of digital watermarking, technique to embed versatility can use 
with the digital-watermarking embedding vessel 107. 

[0050] Moreover, although the 1st and 2nd operation gestalt explained the object which embeds 
digital watermarking as image data, this invention can be applied, not only image data but when 
performing various data compressions to the sound data containing voice etc. and embedding 
digital watermarking to it. 

[0051] Moreover, as shown in drawing 6 A and drawing 6 B, the embedding block of digital 
watermarking shown in the 1st and 2nd operation gestalt can be made to be able to become 
independent, and can also be used as equipment. 

[0052] As shown in drawing 7, a switch 1 1 1 can be formed in front of a quantizer 103, and the 
DCT coefficient inputted into a quantizer 103 can also be chosen from which output of the 
image transformation machine 102 or the digital-watermarking embedding machine 107. If it does 
in this way, in the 1st and 2nd operation gestalt, it is possible to share the entropy encoder 104 
and a quantizer 103 between compression processing of image data and embedding processing of 
digital watermarking, and still more efficient equipment can be realized. 

[0053] Moreover, it sets to an image processing system equipped with a picture compression 
block and an image expanding block. By leading the output of the reverse quantizer 109 for 
image expanding to the digital-watermarking embedding machine 107, and forming a switch 1 1 1 in 
front of a quantizer 103 further, as shown in drawing 8 It is possible to share the entropy 
encoder 104 and not only the quantizer 103 but the entropy decoder 106 and the reverse 
quantizer 109 for expanding processing between embedding processing of digital watermarking, 
and still more efficient equipment can be realized. In addition, the image inverter 112 performs 
processing of the image transformation machine 102 and reverse. 
[0054] 

[The 4th operation gestalt] Hereafter, the image processing system of the 4th operation gestalt 
concerning this invention is explained. In addition, in this operation gestalt, about the same 
configuration as each above-mentioned operation gestalt and abbreviation, the same sign is 
attached and the detailed explanation is omitted. 

[0055] Drawing 9 and drawing 10 are the block diagrams showing the example of a configuration 
of the equipment which extracts digital watermarking from the compressed data with which 
digital watermarking was embedded, and the example of a configuration corresponding to the 
embedding equipment of digital watermarking which shows drawing 9 to drawing 6 A, and drawing 
10 are examples of a configuration which do not need the reverse quantizer corresponding to the 
embedding equipment of digital watermarking shown in drawing 6 B. 
[0056] The data inputted into the equipment shown in drawing 9 and drawing 10 is the 
compressed data with which digital watermarking was embedded. The compressed data inputted 
is changed into quantization data by the entropy decoder 501 corresponding to the entropy 
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encoder 108 used for the embedding of digital watermarking. With the configuration shown in 
drawing 9, after the obtained quantization data is changed into the coefficient for which it 
depends on the image transformation methods, such as a DCT coefficient, with the reverse 
quantizer 502 corresponding to the quantizer 110 used for the embedding of digital watermarking, 
it is inputted into the digital-watermarking extractor 503. Quantization data is inputted into the 
digital-watermarking extractor 503 with the configuration shown in drawing 10. 
[0057] The digital-watermarking extractor 503 extracts the digital-watermarking information 
embedded by the extract processing corresponding to the embedding of digital watermarking. 
Extract processing of this digital watermarking should just be the technique corresponding to 
embedding processing of digital watermarking using the discrete cosine transform explained with 
the 1 st and 2nd operation gestalt, and embedding processing of digital watermarking using the 
various image transformation explained with the 3rd operation gestalt. 

[0058] The image processing system of each operation gestalt mentioned above is applicable to 
a picture input device like a digital camera. In that case, though picture compression processing 
in these picture input devices is hardware-ized, if digital-watermarking embedding processing is 
realized by supplying a program to CPU, digital-watermarking embedding processing can be 
realized easily, without adding new hardware. Furthermore, since a real-time operation is not 
necessarily required of digital-watermarking embedding processing unlike data compression 
processing, when transmitting data to a personal computer etc. from picture input devices, such 
as a digital camera, or while the picture input device is not performing the image input, it can 
perform embedding processing of digital watermarking. Then, even when the throughput of CPU 
carried in the picture input device is small, it is possible to perform embedding of digital 
watermarking for a short time. 

[0059] Moreover, the image processing system of each operation gestalt mentioned above 
applicable also to an image I/O device like color facsimile equipment is clear. In that case, when 
digital watermarking embedded by the picture input device includes the digital-watermarking 
extract function shown in the 4th operation gestalt in an image output unit, the embedded 
digital-watermarking information is extracted. Under the present circumstances, when the 
regulation information over an image output is shown by the embedded digital-watermarking 
information, it is also possible to control an image output unit according to that regulation 
information. 

[0060] Moreover, each operation gestalt applicable to many systems, such as a still picture 
transmission system, a still picture processing system, etc. with compression applications, such 
as JPEG, mentioned above is clear. 

[0061] As explained above, according to each operation gestalt mentioned above, by adding the 
easy processing means for the image processing system which has a picture compression 
function, digital-watermarking information can be embedded to the compressed data, and digital- 
watermarking information can be extracted. 
[0062] 

[Other operation gestalten] In addition, even if it applies this invention to the system which 
consists of two or more devices (for example, a host computer, an interface device, a reader, a 
printer, etc.), it may be applied to the equipments (for example, a copying machine, facsimile 
apparatus, etc.) which consist of one device. 

[0063] Moreover, it cannot be overemphasized by the purpose of this invention supplying the 
storage which recorded the program code of the software which realizes the function of the 
operation gestalt mentioned above to a system or equipment, and carrying out read-out 
activation of the program code with which the computer (or CPU and MPU) of the system or 
equipment was stored in the storage that it is attained. In this case, the function of the 
operation gestalt which the program code itself read from the storage mentioned above will be 
realized, and the storage which memorized that program code will constitute this invention. 
Moreover, it cannot be overemphasized that it is contained also when the function of the 
operation gestalt which performed a part or all of processing that OS (operating system) which is 
working on a computer is actual, based on directions of the program code, and the function of 
the operation gestalt mentioned above by performing the program code which the computer read 
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is not only realized, but was mentioned above by the processing is realized. 
[0064] Furthermore, after the program code read from a storage is written in the memory with 
which the functional expansion unit connected to the functional expansion card inserted in the 
computer or a computer is equipped, it cannot be overemphasized that it is contained also when 
the function of the operation gestalt which performed a part or all of processing that CPU with 
which the functional expansion card and functional expansion unit are equipped based on 
directions of the program code is actual, and mentioned above by the processing is realized. 

[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1 A] The block diagram explaining the outline of image coding equipment, 
[Drawing 1 B] The block diagram explaining the outline of image decode equipment, 
[Drawing 2 A] The block diagram explaining the outline of digital-watermarking embedding 
equipment, 

[Drawing 2 B] The block diagram explaining the outline of a digital-watermarking extractor, 
[Drawing 3] The block diagram explaining the outline of the equipment which embeds digital 
watermarking at compressed data, 

[Drawing 4] The block diagram showing the example of a configuration of the image processing 
system of the 1 st operation gestalt, 

[Drawing 5] The block diagram showing the example of a configuration of the image processing 
system of the 2nd operation gestalt, 

[Drawing 6 A] The block diagram showing the example of a configuration of the image processing 
system of the 3rd operation gestalt, 

[Drawing 6 B] The block diagram showing the second example of the image processing system of 
the 3rd operation gestalt, 

[Drawing 7] The block diagram showing the third example of the image processing system of the 
3rd operation gestalt, 

[Qrawjrig 8] The block diagram showing the fourth example of the image processing system of 
the 3rd operation gestalt, 

[Drawing 9] The block diagram showing the example of a configuration of the image processing 
system of the 4th operation gestalt, 

[ Drawin gJO] It is the block diagram showing the second example of the image processing system 
of the 4th operation gestalt. 



[Translation done.] 
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